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<N Abstract 

u 

r^ Central moments and cumulants are often employed to characterize the distribution of 

data. The skewness and kurtosis are particularly useful for the detection of outliers, the 
QQ assessment of departures from normally distributed data, automated classification tech- 

P\J niques and other applications. Robust definitions of higher order moments are more stable 

but might miss characteristic features of the data, as in the case of astronomical time series 

^—i with rare events like stellar bursts or eclipses from binary systems. Weighting can help 

<^ identify reliable measurements from uncertain or spurious outliers, so unbiased estimates 

of the weighted skewness and kurtosis moments and cumulants, corrected for sample-size 

i-^ biases, are provided under the assumption of independent data. The comparison of biased 

1^ and unbiased weighted estimators is illustrated with simulations as a function of sample 

O size, employing different data distributions and weighting schemes. 

u 

a 1 Introduction 



< 



Descriptive statistics provide essential tools to quantify the main features of data and typically consist 
^>^ of simple quantities which can be computed efficiently and easily included in the analysis of large data 

_^ volumes. The ability to summarize essential information in a few parameters has found widespread inter- 

^^ disciplinary applications. Central moments characterize the shape of the distribution of measurements 

lO around the mean value for most distributions occurring in practice. The familiar moments of variance, 

>0 skewness and kurtosis give indications on the dispersion, asymmetry and peakedness or weight of the 

■^ tails of the distribution, respectively. 

^^ Moments are usually computed on random variables. Herein, their application is extended to data 

^^ generated from deterministic functions and randomized by the uneven sampling of a finite number of 

. . measurements and by their uncertainties, whereas the corresponding 'population' statistics are defined in 

^ the limit of an infinite regular sampling with no random or systematic errors. This scenario is common in 

astronomical time series, where measurements are typically non-regular due to observational constraints, 
5^ they are unavoidably affected by noise and sometimes also not very numerous: all of these aspects 

Cd introduce some level of randomness in the characterization of the underlying signal of a star. 

While the effects of noise and sampling on time series are studied in Rimoldini (2013a|b), this work 



X 



addresses the bias, precision and accuracy of weighted estimators in the case of small sample sizes. Bias 
is defined as the difference between expectation and population values and thus expresses a systematic 
deviation from the true value. Precision is described by the dispersion of measurements, while accuracy 
is related to the distance of an estimator from the true value and thus combines the bias and precision 
concepts (e.g., accuracy can be measured by the mean square error, defined by the sum of bias and 
uncertainty in quadrature). 

Higher moments such as skewness and kurtosis have received particular attention for the detection of 



outliers and of departures from normally distributed data (D'Agostino 19861. The underlying concepts 



can be expressed in many alternative ways, some of which (e.g.. Moors et al. 



1996 Hosking 1990 
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Groeneveld & Meeden 1984 Bowley 1920 1 avoid sample means or non-linear transformations and favour 
more robust results. While insensitivity to a few botched measurements is a clear advantage, sometimes 
outliers are part of the targeted signal, as in the case of eclipses occurring in the light curves of binary 
star systems. Since weighting can help distinguish meaningful outliers (e.g., the data corresponding to 
eclipsed phases) from spurious measurements, the present work focusses on the conventional definitions 
of skewness and kurtosis in terms of central moments and cumulants, and provides sample-size corrected 
('unbiased') estimates of the weighted formulations. 

Sample moments do not provide unbiased estimates of population moments. As the sample size 
decreases, the uncertainty of the sample mean around the population value increases and higher order 
central moments can become biased as a result. Statistical estimators which remain unbiased as a function 
of sample size are relevant to those applications which aim at the characterization of the population 
which the measured sample represents. This approach is particularly important for the interpretation 
and comparison of data in a broader context than the sole description of a sample. 

Weighting can quantify the relevance of measurements (e.g., by inverse-squared uncertainties), enhance 
targeted features of the data depending on the objectives of the analysis, and have different implications 
on the precision and accuracy of estimators: 

(i) They might decrease, because weights assign more importance to some data at the expense of other 
ones, effectively reducing the sample size as results depend mostly on fewer 'relevant' measurements. 
This case is apparent in Sec. [5] for example, when weighting by the inverse-squared uncertainties 
at high signal-to-noise {S/N) ratios. 

(ii) They might increase, when weights reduce greater dispersions and biases than the ones caused by 
an effectively smaller sample. For example, weighting by inverse-squared uncertainties was shown 



to improve both precision and accuracy at low S/N levels (Rimoldini 2013a I. 



Weighting might exploit correlations in the data to improve precision (Rimoldini 2013b). Since correlated 
data do not satisfy the assumptions of the expressions derived herein, their application might return 
biased results. However, small biases could be justified if improvements in precision are significant and, 
depending on the extent of the application, larger biases could be mitigated with mixed weighting schemes, 
such as the one described in Sec. [5] 

Similarly to the pros and cons of weighting, unbiased estimators are expected to be more accurate 
but less precise than the biased counterparts, since they take into account the uncertainty of the sample 
mean. Thus, they are favoured when biases from small sample sizes are larger than the dispersion of 
unbiased statistics. A compromise solution (weighted or unweighted, biased or unbiased) should balance 
biases against the dispersion of weighted or unbiased estimators (which might depend on the statistics 
and the data), improve the overall accuracy and be applied uniformly to all data. 

Unbiased expressions are derived for the weighted skewness and kurtosis (central moments and cu- 
mulants) in the case of independent measurements. The results are illustrated with simulated data and 
the dependence of unbiased weighted estimators on sample size is shown for two weighting schemes: the 
common inverse-squared uncertainties and interpolation-based weights as described in Rimoldini^ (20 1 3b[ ) . 
The latter demonstrated a significant improvement in the precision of weighted moments and cumulants 
for data sets with at least a few tens of measurements. 

This paper is organized as follows. The notation employed throughout is defined in Sec. [2] Sample 
(biased) weighted moments and cumulants are recalled in Sec. [SJ Sample-size unbiased weighted and 
unweighted moments and cumulants are presented in Sec. HI Biased and unbiased estimators are compared 
with simulated signals as a function of sample size in Sec.ISj including weighted and unweighted estimators 
and two different signal shapes. Conclusions are drawn in Sec. l6J followed by detailed derivations of the 
sample-size unbiased weighted estimators in App. lA] 
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2 Notation 

For a set of n measurenients x — {xi, X2, ■■■, Xn), the following quantities are defined. 

(i) Population central moments fir = E[{x — iiY] with mea n ;n = E{x.), w here EL) denotes expectation, 
and cumulants K2 = ^J.2, 1^3 = fi^, K4 = 114 ~ i^\ (e.g., Stuart & Ord 1969) M 



(ii) The sum of the p-th power of weights is defined asVp = X]r=i '"'f • 

(iii) Sample central moments tti^ — X]i=i ^i{^i ~ ^Y /Vi and corresponding cumulants fc^. 

(iv) Sample-size unbiased estimates of central moments Mi and cumulants Ki, i.e., E{Mi) — pn and 
E{Ki) = K,. 

(v) The standardized skewness and kurtosis are defined as 51 = kzjk^ ' 52 = k^/k"^, Gi — K3/K2 , 
and G2 = K4/K2, with population values 71 = K3/K2 and 72 — H4/ k\. Gi and G2 satisfy 
consistency (for n — > 00) but are not unbiased in general (e.g., see Heijmans 1999 for exceptions). 



(vi) No systematics or other instrumental errors are considered herein and uncertainties are often referred 
to as errors. 

(vii) Statistics weighted by the inverse-squared uncertainties are called 'error-weighted' for brevity and 
interpolation-based weights computed in phase ([Rimoldini 2013b) are named 'phase weights'. 



3 Sample moments and cumulants 

The sample weighted central moments, such as the variance m2, skewness 7TI3, kurtosis m^ and the 
respective cumulants, are defined in terms of the weighted mean x as follows: 



1 " 



Vi 



WiXi 



7712 



ms 



1 " 

= — ^ Wi{x^ - xf = /C2 



Vi 



1 " 

j^^Wi{xi - xf = ks 



Vi 



i=l 



1 

i — 1 
k4 = 777,4 ~ 3 7772 ■ 



Xi X j 



(1) 

(2) 

(3) 

(4) 
(5) 



The unweighted forms can be obtained by substituting Wi = 1 (for all i) and Vi = rt in the above 
equations. 



^Cumulants, first derived by |Thiele| ( 1889|l, have also been named 'cumulative moment functions' ( |Fisher[ |1929| and 
'semi-invariants' by other authors (e.g. , ICramerl 119611 IDressell |1940L 
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4 Sample-size unbiased moments and cumulants 

The sample-size bias corrected weighted central moments, such as the variance M2, skewness M3, kur- 
tosis M4 and the respective cumulants are derived assuming independent measurements and weights, as 
described in full detail in App. [^ They are defined in terms of sample estimators as follows: 

V? 
M2 = TPT^ ™2 = K2 (6) 



v['-v. 



2 



^ {V^ - V2){V^ - W^V2 + SFi^s + 3K,' - 61^4) ™^ 



Wl{2VlV2 - WyVz - 3lf + 3F4) 



{Vx - y2Wx - QV^V2 + 8^1 F3 + 31^2^ - 6F4) 

Vi^(T//~ 41/11^3 + 3^2') 

? - V2){V^ - W^V2 + 8Viy3 + 3T/2' - 61^4) ™'' 

■JY^iyt - 2V^V2 + 41^1^3 - 3^2^) 
{V^ - V2){V^ - QV^V2 + 8V1F3 + 3^2^ - 6F4) 



(8) 



(9) 



The corresponding unweighted forms can be achieved by direct substitution T^ = n for all p, leading 



to the known relations (e.g., see Cramer 1961): 

(10) 
(11) 
(12) 

(13) 

5 Estimators as a function of sample size 

The effect of different weighting schemes on sample and population estimators is illustrated as a function of 
sample size with simulated data, through which biased and unbiased estimators are compared for specific 
periodic signals, sampling and error laws. The values of the population moments of the continuous 
simulated periodic 'true' signal ^((/)) are computed averaging in phase (j) as follows: 

1 r^- _. , 1 z-^- 



M2 -~ 
M3-- 


- ^12 = K2 

n — 1 






-(n-l)(n-2)"^^-'^^ 
nin^ - 2n + 3) 


3n(2n - 3) 


(n-l)(n-2)(n-3) " 
n2(n + l) 


(n- 


-l)(n-2)(n-3) 
3n2 2 


(n-l)(n-2)(n-3) " 


[n- 


-2)(n-3)"^- 



[^{4>) - ^iY dcj,, where ^i ^ ^ C(0)d0- (14) 



5.1 Simulation 



Simulated signals are described by a simple sinusoidal function to the first and the fourth powers. The 
signal ^(0) with variance 112 and signal-to- noise ratio S/N (estimated by the ratio of the standard devi- 
ation y^/i2 a-iid the root of the mean of squared measurement uncertainties e^) is sampled from rt = 10 to 
1000 times at phases (pi randomly drawn from a uniform distribution: 

'e(0)-eo + Asin",^ (15) 

.-AA(e„e^) for ^^^i{4>^) and 0, - W(0, 27r) (16) 

'■^{l + p,) ^l2/{S/Nf for p, ^^^(-0.8,0.8), (17) 
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Figure 1: Simulated signals of the forms of sin (}> (solid blue curve) and sinc/i (dashed red curve) are 
irregularly sampled by 50 measurements (denoted by blue triangles and red circles, respectively) with 
S/N = 100. 



Table 1: Population values of the estimators illustrated in Figs [2- 16 



Population Equivalent Population values for ^((/)) = ^o + A sin" ( 
Statistics Expression a — 1 a — A 
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M4 
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/ 3/2 
K3/K2' , 


1^3/(4^^ 





^1152/4913 « 0.484 


72 


K4/K2, fl4 


/m1-3 


-3/2 


-771/578 w -1.334 



where a = 1, 4 and the i-th measurement Xi is drawn from a normal distribution Af{^i,ef) of mean ^^ and 
variance ef . The latter is defined in terms of a variable pi randomly drawn from a uniform distribution 
U{—0.8, 0.8) so that measurement uncertainties vary by up to a factor of 3 for a given /X2 and S/N ratio. 
Simulations were repeated 10^ times for each sample size. 

The dependence of estimators on noise and the corresponding unbiased expressions were presented in 



Rimoldini (2013a). Herein, the S/N ratio is set to 100 so that noise biases are negligible with respect to 
the ones resulting from small sample sizes. Sample signals and simulated data are illustrated in Fig. [l] for 
n = 50. The reference population values of the mean, variance, skewness and kurtosis of the simulated 
signals are listed in Table [TJ 
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Error weights are defined by 
phase-sorted data: 



Wi 



1/ef, while phase weights follow Rimoldini (2013b), assuming 



Wi = /i(n|a, 6) 



Wi 



En 
.7 = 1 

w'n^ fl^l- 4'n-l + 27r 



■'3 = 

+ 27r 



— + [l-h(n\a,h)]/n Vie(l,n) 

Vie (2,n-l) 



h{n\a, b) = 



1 



1 + e^("^'^)/'' 



for a, & > 0. 



(18) 

(19) 
(20) 
(21) 

(22) 



Estimators derived herein assume a single weighting scheme and combinations of estimators (like the 
variance and the mean in the standardized skewness and kurtosis) are expected to apply the same weights 
to terms associated with the same measurements. The function /i(n|a, h) constitutes just an example to 
achieve a mixed weighting scheme: tuning parameters a, h offer the possibility to control the transition 
from unweighted to phase-weighted estimators (in the limits of small and large n, respectively) and thus 
reach a compromise solution between precision and accuracy for all values of n, according to the specific 
estimators, signals, sampling, errors, sample sizes and their distributions in the data. 

5.2 Results 

Figure [2] illustrates the sample mean in the various scenarios considered in the simulations at S/N = 100: 
unweighted and with different weighting schemes (error- weighted and phase- weighted) . While accuracy 
is the same in all cases, the best precision of the mean is achieved employing phase weights, with no need 
to limit interpolation within large gaps for small sample sizes. 

Figures [3f [16| compare biased and unbiased estimators as a function of sample size, evaluating the 
following deviations from the population values: 



M2^2 - 1 



vs r7i2/A*2 - 1, 

/ 3/2 

vs m^l ^,2 



Mi/ III 
Ki/iil 



71, 
-3-72 vs 7714/^^2-3-72, 

-72 vs fc4/^2-72, 



Gi-71 
Mi/M^ - 

G2 -72 



vs 51 -71, 



3-72 vs 7774/7772-3-72, 
vs 52 -72, 



(23) 
(24) 
(25) 
(26) 



in both weighted and unweighted cases, for signals of the forms sint/) and sin </>, with S/N — 100. 
Estimators standardized by both true and estimated variance are presented to help interpret the behaviour 
of the ratios from their components. 

Biased and unbiased estimators are quite similar in the limit of large sample sizes (typically n > 100). 
When weighting by errors, or not weighting at all, unbiased estimators are accurate throughout the whole 
range of sample sizes, as expected, although their precision decreases at lower values of 77. The biased 
counterparts are more precise but less accurate, with a degradation of both accuracy and precision at 
low 77. 

Estimators which involve ratios (and powers) of unbiased estimators are not expected to be unbiased 
in general. Figures Isl-jsland 13 16 show that the ratios gi,(?2 of sample estimators (weighted or not) are 
more precise and accurate than the ratios Gi, G2 of the respective unbiased counterparts. 

Weighting by phase intervals leads to a significant improvement in precision of all estimators in the 
limit of large sample sizes 77 and a reduction of accuracy of many 'unbiased' estimators at low 77, because 
of the introduction of correlations through phase weights (as the closer measurements are in phase, the 
more similar their values are likely to be; see Rimoldiiij] 2013b). Tuning parameters such as a = 25 
and & = 6 in Eq. ( 18 1 have shown to be able to mitigate the inaccuracy of unbiased estimators at low 77 



and reduce to the unweighted results, which appear to be the most accurate and precise in the limit of 
small sample sizes (in these simulations). This solution might provide a reasonable compromise between 
precision and accuracy of unbiased estimators, at least for sample sizes 77 > 10. 
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Estimators of sinusoidal signals appeared more precise than those arising from the fourth power of a 
sine, with the exception of the mean, for which the relative precision of the two signal shapes reversed in 
most cases. 

From the comparison of sample-size biased and unbiased estimators with different weighting schemes 
for the two periodic signals considered, it appears that, at high S/N ratios, sample-size biased phase- 
weighted estimators (with a,b ^>- 0) have the best precision and accuracy in general, with the exception of 
7712, "^3 Bind 7714/7772, which become biased especially for n < 20. Further improvements might be achieved 
by tuning parameters better fitted to estimators and signals of interest, in view of specific requirements 
of precision and accuracy. 

6 Conclusions 

Exact expressions of weighted skewness and kurtosis corrected for sample-size biases are provided in 
Eqs (17])-(|9| under the assumption of independent measurements and weights. Such estimators are par- 
ticularly useful when the adoption of a weighting scheme is important for the processing of the data and 
accuracy needs to be preserved at small sample sizes. 

Simulations of irregularly sampled symmetric and skewed periodic signals were employed to compare 
sample-size biased and unbiased estimators as a function of sample size in the unweighted, inverse-squared 
error weighted and phase-interval weighted schemes. While phase weighting introduced correlations (not 
considered by the unbiased weighted expressions) , a mixed phase and error weighting scheme was able to 
balance precision and accuracy on a wide range of sample sizes. 
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Figure 2: Sample mean of sincj) and sin^ ^ for n S (10, 1000) and S/N — 100: miweighted on the top-left 
hand side, weighted by the inverse of squared measurement errors on the top-right hand side, weighted 



by phase gaps, as defined by Eq. (18), with different parameter values, as specified above the lower 



panels. Shaded areas encompass one standard deviation from the average of the distribution of the mean 



employing simulations defined by Eqs (15|-(17) 
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n G (10, 1000) and S/N = 100: unweighted on the top-left hand side, weighted by the inverse of squared 



measurement errors on the top-right hand side, weighted by phase gaps, as defined by Eq. (18 1, with 
different parameter values, as specified above the lower panels. The correlations introduced by phase 
weights are expected to bias the otherwise 'unbiased' variance. Shaded areas encompass one standard 



deviation from the mean of the distribution of the variance employing simulations defined by Eqs ( 15 ) 



(17). 
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Figure 4: Sample {'biased') variance r7i2 of sin (j) versus its population {'unbiased') estimate M2 for 
n e (10, 1000) and S/N = 100: unweighted on the top-left hand side, weighted by the inverse of squared 



measurement errors on the top-right hand side, weighted by phase gaps, as defined by Eq. (18 1, with 
different parameter values, as specified above the lower panels. The correlations introduced by phase 
weights are expected to bias the otherwise 'unbiased' variance. Shaded areas encompass one standard 



deviation from the mean of the distribution of the variance employing simulations defined by Eqs ( 15 ) 



(17). 
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Figure 5: Sample {'biased') skewness m^ of sine/) versus its population {'unbiased') estimate M3 for 
n € (10, 1000) and S/N = 100: unweighted in the upper panels and weighted by the inverse of squared 
measurement errors in the lower panels. Shaded areas encompass one standard deviation from the mean 



of the distribution of the skewness employing simulations defined by Eqs (15)-(17l 



Weighted skewness and kurtosis unbiased by sample size 



page 11 of 33 



Skewness 

(sine/)) 



Phase Weighted (a, 6 — > 0) 



I 



C^ CM 



1.5 

1.0- 

0.5 

0.0 
-0.5 
-1.0 















— Biased 






















■■■■ Unbiased 






























^^ 














































1 1 









0.00 0.02 0.04 0.06 0.08 0.10 

(Sample size)"^ 
Phase Weighted (a = 25, fe = 6) 



I 



1.5- 










— Biased 








1 n 










---■ Unbiased 














0.5- 




















n 1^ 




^^ 










1 n 










1 1 1 





0.00 0.02 0.04 0.06 0.08 0.10 



Phase Weighted (a, 5 -> 0) 



I 



1.5- 

1.0- 

0.5- 

° 0.0- 

-0.5- 



Biased 
Unbiased 



-1.0- 



I I I I I I 

0.00 0.02 0.04 0.06 0.08 0.10 

(Sample size)"^ 
Phase Weighted (a = 25, 5 = 6) 



1.5- 










— Biased 


















B- Unbiased 












_ 


' 05 








6) 

O r\ n - 




-0.5- 




^^ 






1 n 








1 1 1 1 







0.00 0.02 0.04 0.06 0.08 0.10 



(Sample size) ^ 



(Sample size) ^ 



Figure 6: Sample {'biased') skewness m^ of sincj) versus its population {'unbiased') estimate M3 for 



n G (10, 1000) and S/N = 100, weighted by phase gaps, as defined by Eq. (18 1, with different parameter 



values, as specified above each panel. Shaded areas encompass one standard deviation from the mean of 



the distribution of the skewness employing simulations defined by Eqs (15|-(17) 
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Figure 7: Sample {'biased') skewness m^ of sin versus its population {'unbiased') estimate M^ for 
n e (10, 1000) and S/N = 100: unweighted in the upper panels and weighted by the inverse of squared 
measurement errors in the lower panels. Estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the skewness employing simulations defined by Eqs ( 15 1-( 17 ). 
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Figure 8: Sample {'biased') skewness 7713 of sin (p versus its population {'unbiased') estimate M3 for 
n £ (10, 1000) and S/N = 100, weighted by phase gaps, as defined by Eq. (18), with different parameter 



values, as specified above each panel. The correlations introduced by weights are expected to bias the 
otherwise 'unbiased' skewness. Also, estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the skewness employing simulations defined by Eqs ( 15 1-( 17 ). 
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Figure 9: Sample {'biased') kurtosis 1124 of sin0 versus its population {'unbiased') estimate M4 for 
n G (10, 1000) and S/N = 100: unweighted in the upper panels and weighted by the inverse of squared 
measurement errors in the lower panels. Estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs ( 15 )-( 17 1 
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Figure 10: Sample {'biased') kurtosis TO4 of sin0 versus its population ('unbiased') estimate AI4 for 
n e (10, 1000) and S/N = 100, weighted by phase gaps, as defined by Eq. (18), with different parameter 



values, as specified above each panel. The correlations introduced by weights are expected to bias the 
otherwise 'unbiased' kurtosis. Also, estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs (15)-(17l 
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Figure 11: Sample {'biased') kurtosis m^ of sin </> versus its population {'unbiased') estimate M4 for 
n e (10, 1000) and S/N = 100: unweighted in the upper panels and weighted by the inverse of squared 
measurement errors in the lower panels. Estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs ( 15 )-( 17 1 
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Figure 12: Sample {'biased') kurtosis 7714 of sin ip versus its population {'unbiased') estimate M4 for 
n £ (10, 1000) and S/N = 100, weighted by phase gaps, as defined by Eq. (18), with diS'erent parameter 



values, as specified above each panel. The correlations introduced by weights are expected to bias the 
otherwise 'unbiased' kurtosis. Also, estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs (15)-(17l 
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Figure 13: Sample {'biased') kurtosis A;4 of sint/f versus its population {'unbiased') estimate K4 for 
n G (10, 1000) and S/N = 100: unweighted in the upper panels and weighted by the inverse of squared 
measurement errors in the lower panels. Estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs ( 15 )-( 17 1 
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Figure 14: Sample {'biased') kurtosis k^ of sin(/) versus its population ('unbiased') estimate K/^ for 
n e (10, 1000) and S/N = 100, weighted by phase gaps, as defined by Eq. (18), with different parameter 



values, as specified above each panel. The correlations introduced by weights are expected to bias the 
otherwise 'unbiased' kurtosis. Also, estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs (15)-(17l 
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Figure 15: Sample {'biased') kurtosis fc4 of sin cj) versus its population {'unbiased') estimate K4 for 
n e (10, 1000) and S/N = 100: unweighted in the upper panels and weighted by the inverse of squared 
measurement errors in the lower panels. Estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs ( 15 )-( 17 1 
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Figure 16: Sample {'biased') kurtosis k^ of sin (f> versus its population {'unbiased') estimate K4 for 
n £ (10, 1000) and S/N = 100, weighted by phase gaps, as defined by Eq. (18), with different parameter 



values, as specified above each panel. The correlations introduced by weights are expected to bias the 
otherwise 'unbiased' kurtosis. Also, estimators labeled as 'unbiased' but involving ratios or powers of 
unbiased estimators are not expected to remain unbiased. Shaded areas encompass one standard deviation 



from the mean of the distribution of the kurtosis employing simulations defined by Eqs (15)-(17l 
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A Derivation of sample-size unbiased weighted moments 

The derivations presented in this Appendix involve weighted estimators under the assumption of indepen- 
dent measurements and weights. Definitions and some of the relations often employed herein are listed 
below. 

• Averages are weighted as ^ = X]"=i WiOi/Vi. 

• Ellipses indicate the existence of terms with null expected value. 

• Xa and Xb denote two different representatives from independent and identically distributed elements 
so that, for example, E(xaXb) ~ E{xa)E{xi,) — fi^. 

• ^^ is implied to sum over all (from the 1-st to the n-th) terms, unless explicitly stated otherwise. 

• While E{wl) — w\ for the specific «-th value, for a generic weight Wa it equals E[w^) — ^^ w^wf /Vi = 
Vp+i/Vi, so E{wa) = w = V2/VU E{wl) = 1/3/^1 and so on. 



^j ""^ 






= Wa E. Wi + Y.^^a ^^ E„ 

= wl+Wa Y^i^a ^i + ^a J2i=^a '^i + Ej^a '«» Ej^a ^ 

= wl+ 2Wa T,t^a ^^ + T,i^a «^? + T,^^a ^t T,3^t,a 

= V2+ 2Wa E»5^a ^^ + Ei#a ^i T.j^^,a ^J- 

• ^1 = E. Wi J^j Wj J2k ^k 

= Wa E. Wi J2j Wj + J2z^a Wr Ej Wj J^k ^k 

= Wl J2^ Wi + Wa "Zt^a ^i Ej Wj + Wa E^^a ^* Ej Wj + J^t^a ^t Ej^a ^j Efe Wk 

= wl+wl J2i^a Wi + ^a Ei5^a '^i + ^a Y^i^a "^^ Ej^a '^J + ^a Y^i^a ^i + 

+ Wa J2^^a '^^ Ej^a ^j + ^a J2,^a ^t Ej^a ^j + lli^a W^ J2j^a ^j J2k^a ^k 
= wl + iwl J2i^a W^ + 3Wa J2t^a ^r Ej^a "'i + Ez/a ^i J2j^a ^j J2k^a ^k 
= wl + 3wl J2i^a W^ + 3Wa Yt^a ^f + ^^a E^^a ^» "Ej^z^a '^3 + E^^a "^f + 
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W 



• n'-^2 = E,E,^. 



WiW 



i^r 



' ''-^^.^zwW, 



• ^2'-^4-E.E 



• < E:;.a wf = ^P^«) - ^«+') = iVpy^+i - ^p+^+o/^i- 



Ei W* Ej W| = W^ + Wa Y^z^a Wf + wl J^z^a ^^ + E^^a ^f + Yz^a ^^ T,j^z,a ^h ^^^^ 
Ei Wz Yj Wj =wl + 2Wa E.,5^a ^^ + Ej^a ^f + E^^a ^^ Ej>i»,a Wj , thuS 
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A.l Outline of results 

The expressions of the elements pursued along the derivation of sample-size unbiased estimators (detailed 
in Sec. A. 2 ) are summarized below, following the notation introduced in Sec. p] 



E[{x-^lf]=V2^i2/vl (27) 

E [{x - ^lf] = V^^i:,/V^ (28) 

E [{x - /i)4] = [14/^4 + 3 {Vi - V,) til] /V^ (29) 

E{xl) = fi2 + m' (30) 

Eixl) = /i3 + 3/i2Ai + m' (31) 

E{xt) =fi4+ 4m3A* + 6/i2M' + / (32) 

E{x^) = V2fi2/V^ + tJ-^ (33) 

^(x^) = yg/is/n' + 3V2M2Ai/V^' + m' (34) 

E{x^) = Vitxi/V^ + 3 (F2' - Vi) til/V^ + 41/3^3^/^' + 6y2M2/iV'l^i' + / (35) 

£;(x,S) = V2ti2/V^ + A*' = S(S') (36) 

^(x^s) = F2Ai3/n' + (1 + 21/2/Vl') Ai2/i + /i' (37) 

i;(xaS2) - KsMs/V'i' + 3F2/i2M/V^i' + m' = ^(S') (38) 

E{xlx) - y2Ai4/n' + (1 + 3V2/V1') M3M + 3(1 + T/2/V^i') A^2m' + A^^ (39) 

£;(xaa;3) = Vitii/V^ + 3 (l/^ - V^) ^HV^ + 4y3Ai3M/"^^i' + 6V^2M2A*VV^i' + / = ^(S^) (40) 

E{xix'') = F3/i4/yi^ + 2 (^3/1^1' + 1^2/1^1') /i3M + (1 + ^y^ivl) i^^iJ? + (^^2/^1' - y^ivl) A + / (41) 

E{m2) = (1 - F2/V^i') M2 - /i2 - ^ [(i - m)'] (42) 

E{jn^) = (1 - 3^2/^' + 2^3/^^!^) M3 = M3 - (31/1^2/^3 - 2) £; [(x - /i)3] (43) 

^(m4) = (1 - 4^2/^' + 6^3/^^!^ - 3^4/^1^) A*4 + W2lyx - VzlVl) - %Vi - Vi)/V^] t4 (44) 

= (1 - W2/V^ + QV^M) M4 + 6 (^2/1^1' - V^/V^) til - 3E [{x - ti)^] (45) 

E{ml) = {V2/V^ - lY^lVl + ^4/1^1^) M4 + [1 - 3V2/n' + 2^3/^' + 3(V^2' - yA)ly^\ [A (46) 

= (V^2/n' - 2^3/^1^ + ^4/^^!*) K4 + [1 - ^VzlVl + 3^4/1^1* + 3(lf - Va)IVi\ a 
E{h) = (1 - 7^2/1^1' + 12^3/^1^ - 6^4/1^1'*) Ki~6 [V2/V^ - WzlVl + W^IV^ + 3(lf - l/4)/l^] 



(47) 

(48) 
M2 = TT^^ m2 = i^2 (49) 



Vl - W1V2 + 2V: 



^k = ,,3 ol\r , OT. "^3 = K3 (50) 



3 
Fi2(T//- 3^12^2 +2^1^3+31^-3^4)^4 3Fi2(2F]2y2- 21/1^3-3^^+3^4)^2 

"" (T^i^ - F2)(^/ - 6^12^2 + 8T/1V3 + 3^2^ - 6V4) ^ (V^i^ - ^2)(V"i* - QV^V2 + 8Fi\/3 + 3Vi - 6F4) 



i^A 



(51) 

If (Vf - 4Fi ^3 + 3 V? ) m4 3^1^ (F/ - 2V^ V2 + 4Fi ^3 - 3V? ) m^ 

(V^ - V2){V^ - 6^12^2 + sv^^Vg + 3^22 - 6^4) ~ (V^i^ - l/2)(^i* - 6Vf F2 + 81^1^3 + 3Vf - 6F4) 

(52) 
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A. 2 Detailed computations 



E [{x ^ ^if] = E 



E 



V? 






E 



^ w1{x^ - A*)^ + X! ^*(^^ ~ m) X! ^j(^J ^ '^^ 



j¥i 



^1 



E [{x - ^if] = E 



E 



^-,J2w^E[{x^-^^r] 



W^Xi - fl 






^3 



£; 



E ^»^(^* - A*)^ + 3 E ^«^(^« ~ ^)^ E "'j (^i ^ ^) 



Jt^* 



^1 

y,3 



E [{x - ^^)''] = E 

= E 
1 

1 



^^t.f£;[(x,-M)3] 



/^3 



WjXi - /i 



£; 



Y^ wf{x^ - [if + 3^ w,2(a;, - [if ^ w|(xj - [if 



Fi 



jT^i 






Va . ^vi-Vi 2 



p.4 M4 + 3^"^f74 — A*i 



y4 



(53) 

(54) 

(55) 
(56) 
(57) 

(58) 
(59) 

(60) 

(61) 
(62) 

(63) 

(64) 

(65) 

(66) 
(67) 
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E{xl) = E[{xa-ii + y)''] (68) 

= E[{xa - nf] + 2fiE{xa - /i) + S(m') (69) 

= M2 + A^' (70) 

E{xl) = E[{x,~fi + fif] (71) 

= E[{xa - fi)^] + 3fiE[{xa - fi)^] + 3fi^E{xa - /i) + ^(m') (72) 

= fi3 + 3^2/-* + M^ (73) 

E{xl)^E[{xa-fi + f,)^] (74) 

= E[{Xa - ^l)^] + iflEliXa ~ [lf\ + ^il^E{(Xa ~ ilf\ + V^(x, - /i) + £;(/^4) (75) 

= ^4 + 4/Z3/X + 6^2M^ + y^^ (76) 

ii;(x2) = i?[(s-^ + ^)2] (77) 

= £;[(x - ^)2] + 2y.E[x ~fi) + E{fi^) (78) 

= V'2/i2/V^i' + m' (79) 

£;(x=') = £;[(i-^ + ^)3] (80) 

= E[{x - nf] + 3nE[{x - ^if] + 3fi^E{x - fi) + E(p^) (81) 

= Vsfis/V^^ + W2^i2li/V^ + /i' (82) 

E{x^)^E[{x~^i + ^lf] (83) 

= £;[(x - ^lf] + 4^S[(x - ^if] + 6m^£:[(x - ^)2] + 4m^£;(x - m) + ^(/) (84) 

= Vi^xi/V^ + 3(1/2' - Vi)^illV^ + 41/3/^3^/^1^ + 6F2A*2/iVV'i' + / (85) 



£'(a;ax) = -E I a;^— /J^i^;^ ) (86) 

(87) 



Xg—y^^wix^ 

— E Waxl +Xa^ WiXi 
\ iy^a J 

^E{waxl) + ^Eixa) Y, ^'Mx,) (88) 

Vi Vi V\ '—^ 



' "; ■ ,^m'E-' (90) 



Vi Vi '"' ■ 1^1 



^2 2 _ n.^;^2 



fl2 + f^' ^ E{x') (91) 
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E{xlx) = E ixl—Y,W^X^j 

= —E Waxl +xl'S2 W^Xi 

= ^EiWaxl) + ^E{xl) Y, W^EiXb) 

Y 3 11 

= —E{Wa)^J.3 + TyWa^^2^J. + TyWafi^ + 77(^2+ M^)/i V W., 
Vi Vi Vi Vi ^ 



I V2 ^2 
Vi Vi ^^ Vi 



V2 

M3 + 2tt2 M2M + (M2 + A^ )^i. 



v. 



V2 ( V2 \ , 



E{xax'') = E 



-^E Xa ^ wlxl + a;a ^ W^Xi ^ 

1 I 

—^E wlxl + a;a ^ wfxj + 2waa;^ ^ w^Xi + a^a ^ i^ja;; ^ 
2 3 11 

^ 111 ^_^^ 



1^1 



1^1 



WjXj 



T^^" \~u,/r-^r-^;^^ -I , 2'^aM M 



2 2 

+ ^E{wa)^i.2^J.'Yw. ' -■ --^ 






1 y 2 

^(M2/^ + A^^) XI ^"^ + 2:r4 M2m5I ^^ + t72^'^'"^ H ' 



i^a 



72 /^' I] ^» H 



^3 



■i^a j^i^a 






^J.2^J. + ^J^ 



V, 



M3 + 3-2M2M + M =^(s ) 



(92) 

(93) 

(94) 

(95) 

(96) 

(97) 
(98) 

(99) 
(100) 
(101) 
(102) 



(103) 



VI ^' ' "Vi 



(104) 

(105) 
(106) 
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= ttE Waxl + a;^ V w^x^ 



jE{w,xl) + ^E{xl) Y, w^E{xb) 



1 



Vi 



3 13 3 1 

E{Wa)^ii + —E{Wa)tJ-3tJ' + TTWa^-il^ + TT ^ [w a) ti2 H^ + T^ W a fJ.2 fJ-'^ + — WaA*'* + 
Vi Vi V\ V\ V\ Vi 






^ M4 + 3:^ M3Ai + 3:^ M2A*^ + ^ (m3 + 3M2Ai + M^) M X! ^* 



1^1 



V. 



V. 



= ^ /^4 + ( 1 + 3:^ I ^3/X + 3 ( 1 + :^ ) /i2/i + /i 



^^2 



£;(a;ax3) = S 



Xa — y^WjXi 



^ \ ^ 3 f^ J 






k^J 



= — 3 S Xa ^ wf a:^ + 3a;a ^ w^Xi ^ w^a;| + Xq ^ WiXi ^ w-,Xj ^ WfcXfc 

= ysE wlxl +XaY^ W^xf + 3Waxl ^ W^X^^ + Swlxl ^ WiX^ + 3Xa ^ WiX^ ^ 
\ i^a i^a i^a i^a j^'i,o, 

+3WaxlYwiX,Y WjXj+Xa^WiX.Y WjXj ^ WkXk 

= ^E{wl)^ii + -^wl^i^.^x + ^wl^l2^^'^ + -^wl^l^ + z^ifis + 3fI2^i + ^J.^)^J-J2'' 

^ 11 11 ^_^^ 



(107) 

(108) 
(109) 

(110) 
(111) 
(112) 

(113) 
(114) 
(115) 
(116) 



2 2 I 



(117) 



j^n^Yl ^' H ^j H 



1/^3 



wfe 



(118) 



iy^f^ jy^h^ ky^ijja 
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1 Va 



^4 + ^ A^SAi XI ^? + t73 ^(^a)Ai3M XI ^» + VV3E{wl)^i2^J.'^ X "'* + tTS ^'^ X ^''' 



Fi3 Fi ^* ' VI 



V? 



V? 



V? 



-y^{|J.2^l'^ + A*'') X ■^^ X ^J + ^Wa(M2A*^ + M^) X "^^ X 



•i^^a j^i^a 



i^a j^i^a 



Vi 



^/X^« X ^j X ^fe 



(119) 






^4 



^3,o^3\ ,r^3 2,4,3 2Y^3| 

3 +3^ j AisM + SYTa A*2/i + A* + ^ tJ-2fJ- 2^w^ + 

3 



^^3 "1^3 



'^ 



O 2 X ^ 2 ^ 2 X ^ 

U'aAi2 2^«^i + 7F3WaA'2A' 2^ 



3 



W^r + :^W^aAi2Ai^X^* 



^1 






-wa^l2^J■' 






(120) 



V4 V3 4 O Vn ^ V4 2 -I r.TA 

= 774 A'4 + 4:^ ^3^ + /i + ^ /i2 + ^ ( 2^3 



3 K,2_V^^ ^ 3 ^^_ T4V^3-V4 „V"2^-14 Vi 145 -1/4 



-V1F2 - F3 - 



K?-V'4 V^1^3-"t^4 



Vi 



Vi 



Vi Vi 

^^^. V, V^V^^V^ V^~Vi 
yiV2 — T} — ^- 



Vi 



Vl 



= :^A*4 + 3 



Vj - Va 2^,V^ ^,V 

— ^^A^2+4^A^3A^ + 6-2 



/i2 +4— 3 ^3/i + 6— 2 Ai2Ai +^ = E{x ) 



E{xlx^) = E 



= Y^^ ^Q^a + a^a E ^«^^^ + '^Wax\ ^ "^i^;, + x^ ^ ^^a;^ ^ ^i^J 



Vl 
fi2fi^ (121) 

(122) 

(123) 
(124) 
(125) 
(126) 



^-E(Wa)Ai4 + :j^^(w^)^3/i + —wl^l3fl+ y^wl^l2^J-'^ + y^wj^l'^ + y^ {fl2 + ^J-'^f Y^'i + 



Vl' 



jWafisfJ-Y 



g ^ 2 ^ 1 

'^i + 772^a^J■2^J'' E ^* + 772^"^^ E "'^ "*" 772 (^2 + M^)M^ E "'^ E 
z^^a z^a i^a i^a j^-i.a 



u;. 



(127) 
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i- i- i- i ^ i^a ^ i '- i 

A 2 2 1 



y^^^ "''^"^ ^^l-^ ' y^^-^r-^r- ,^~^ y^-'^r- ^_^ - . yj. 



i^a 



i^a 



i^a 3^'i,0' 






(128) 



V3 ( V3 V2 

-^ M4 + 2 -3 + :^ ) M3M 



n^ 



n^ y^ 






n^ 



-j^[ii[^^^w, XI ^J+' 



?:^a j^i,a 



^3 ^ . /^ ^3 ^ ^2 \ ^ A ^ , ^2 \ 2 ^ /^ ^2 ^3 \ 2 ^ 4 



(129) 

(130) 



£;(m2) = E 



— ^^Wi{xi -xY 



Vi 



= E [{Xa - Xf] 

= E{x1- 2XaX + x^) 
= i?(a;2) - E{x^) 



Eims) 



E{mA) 



/ 

= 1 
V 


V2\ 








= 112 - E [{x - ixf 




= E 


— ) ]wi{x^-xf 






= E [{Xa - Xf 




^E{xl- 3xlx + 3XaX^ - x^) 




^E{xl)-iE{xlx)+2E{x^) 




= //3 + ?.^l2^J^ + Ai^ - 3 


^2 , A , ^2 ^ 


M2A* + M^ 


(, ^2 ^ „ ^3 \ 




^H,-{i^-2^E[{x-i,f] 




= E 


— ) ;wi(a;, -x)* 







= Eixi) - ^E(xlx) + QE{xlx^) - AE{xaX^) + £;(x'*) 



n \ y^ I o ^2 , J 

2 I ^M3 + 3:^/i2Ai + Ai 



(131) 

(132) 
(133) 

(134) 
(135) 

(136) 

(137) 

(138) 

(139) 
(140) 
(141) 

(142) 
(143) 
(144) 

(145) 

(146) 
(147) 
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fM + 4;U3/i + 6;U2^^ + /i'' - 4 



+ 6 
-4 



V2 



^2 



•y-^2 ;Ai3M + 3(l , ^^2 



y,3 



If T/^2 



V2 \ 2 

1 + 5^ )M2M 






2 \ 2,4 

A'2A* +/^ 



V?-F4 2 ^3 V^2 2 

yi Ai4 + 3 —^ ^^2 + ^Yi ^'^^ ^ l72 ^2M 



^4 + 3 



F4 ^^ ' " ^4 



^2'-Vi 2^, ^3 ^.V^2 2^ 4 



V2 V^3 Vi ■ 

l-4^+6:^-3^)M4 



6(^2 F3A ^ vj-v. 



2 

^J-2 



V2 



V. 



V2 V. 



l-4^+6:^JA^4 + 6(^^-:^)M^-3£;[(x-Mr] 



2 , 4 
H2+^J■ 



(148) 
(149) 
(150) 





/ 




N 21 






(m^) = E 


-y^«;,(x,-a;)2 

\ i / 






^ E 


-> >,(a;2_s2) 

\ i / 






-¥ 


T/ \21 


_ 2^ X2>>,.2 +^(5.4) 




1 ( \ 




1 \ » i o^i I 




= y2 (a*4 + 4Ai3M + 6A*2Ai^ + A*'') + ^ ^2 (^^2 + A*^) + 




-2 


V^i , ^(V. V2\ /^ , , V2 \ 2 , ^ ^2 ^(3 ^ 


M^ 


14 0^2^ -^4 2 .^3 r^y-^ 2 4 
+ ^4^X4 + 3 ^4 /i2+4^3 Ai3Ai + 6^2 M2A* +M 




/ ^^2 ^3 , 14 \ , , / ^2 ^3 ^^2 , ^^3 A 




/ V2 V? -V2 V2 V2 \ 9 / V2 Fi^ - ^2 


-2 


^\ V^ ^Vl ' Vi3 1 3 ^4 JM2 




/I 


'2 

72 
1 


2^^ 1 ^^^ 


Ai4 + 

V 


1 -^' 1-^^ l-'^^^-^^^^^ 





^("^2) = ^ (m4 - ^lA) - "^^ (/^4 - 3/i2) + ^ (/M - S^ia) + 



1^3 „^4 . .Vi-Vi ^ 2 



l_4^+3''4 






„ ^3 ^ V4 \ 



y,4 



M2 



V^^ Va 
1 - 4— + 3 — 






(151) 
(152) 
(153) 
(154) 



(155) 



+ 1 /i'+ 



(156) 
(157) 

(158) 
(159) 
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Eiki 



E{mi) 
1 -4- 



3Eim.l) 



-3 

1-7 
1-7 
1-7 



V^2 , „V3 




L/^2 V3\ ^Vi-VA 


M2+ 






V2 ^ ^3 ^ Vi \ / 


,V2 v-i ^vi-Vi\ 2' 






T/,2+'V,3 


-6^,) ^4 


( V2 V■^ V? - V4 \ o 




^^+12^^- 


-6^,)(m4- 


-'«-(|-4-l-W 


1 ^^'l 


^^+12^^- 


-6^,)«,- 


<|-4-l-- 


^-^4 

y,4 


)-^ 





E{M2) = M2 = ^(^2) ( 1 ,,2 



V2 



Mo^ 



V,' 



V,'^V2 



TO2 = K2 



E{Ms) 
Ms 



^J■3 



E{ms) (1-3 



V2 



V^ - ■W1V2 + 2Vs 



TO3 = 



'VI 



Ks 



E{M4) = fM = I E{mi) - 
E{mi) - 




V^ E{mi) 



Vl{<c,VlV2 - WiVs - Wi + 9V4) ^(m|) 



(160) 

(161) 
(162) 
(163) 
(164) 

(165) 
(166) 

(167) 
(168) 

(169) 

(170) 



(171) 



y^ - 41f ^2 + QViVs - 3^4 (Vf - 4Vf F2 + 6141/3 - W4){V^ - 31f 1^2 + 2I/1F3 + 3^2^ - W^^ 



1- 



{W^V2 - 6I/1F3 - 91/2' + 9V^4) (V\'V^2 - 2F1T/3 + Vi) 
(If - 4yi2y2 + WiVs - 3V4) (Vf - W^V2 + 21/1^3 + 3Vf - 31^) 



(172) 



M4 



V^{V^ - 3Vf 1/2 + 214^3 + iV^ - 31/4) m4 



W^{2V^V2 - 214 F3 - 3Vf + Wi) ml 



{V? - V2){Vt - W^V2 + 8^11/3 + iV^ - 6I/4) (If' - 1^2)(lf* - 6^12^2 + 8I/1F3 + 3Vf - 6^4) 

(173) 
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E{IU) 




(174) 



(175) 



6 



( V2 



4^ 



-Vi 



V2 

v7 






1-7 



12, 



y^2 I --y^3 






i)(> 






.v?-v. 



(176) 



QV^ {V^V2 - WiVa + 3T/4 + 3lf - ZV4) E{r 



V^ - 1V{V2 + VlViVz - 6^4 {Vy - 7V^V2 + 12^1^3 - 6^4) (V^ - 4^1 ^3 + SV^ + 3V^ - SV^ 



6(^121/2-41^^^3+3^4 



^vi 



W4) {V^V2 - 2^1 ^3 + Va] 



(V7 - 7F]2y2 + I2V1V3 - 6F4) {V^ - iViVs + 3^4 + 3^2-^ - 314) 



(177) 



Ka^ 



V^{V^ - AV1V3 + W^) ruA 



3Vf (y4 _ 2Vf 1/2 + 4V1F3 - 3K?) m\ 



{Vi - yi){yi - ^y?y2 + Sl^V^s + 3^2^ - Wa) {V^ - V2){V^ - QV^V2 + WiV^^ + W:^ - QVa) 

(178) 
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